Papers with enhanced models
Modeling Layout Reading Order as Ordering Relations for Visually-rich Document Understanding (2024.emnlp-main)
Copied to clipboard
Chong Zhang, Yi Tu, Yixi Zhao, Chenshu Yuan, Huan Chen, Yue Zhang, Mingxu Chai, Ya Guo, Huijia Zhu, Qi Zhang, Tao Gui
| Challenge: | Existing models of layout reading order do not convey the complete reading order information in the layout. |
| Approach: | They propose to model layout reading order as ordering relations over layout elements . they propose a reading-order-relation-enhancing pipeline to improve model performance . |
| Outcome: | The proposed model outperforms existing models on a visual-rich document dataset and on eight cross-domain VrD-IE/QA tasks without targeted optimization. |
Compositional and Lexical Semantics in RoBERTa, BERT and DistilBERT: A Case Study on CoQA (2020.emnlp-main)
Copied to clipboard
| Challenge: | Existing knowledge transfer models do not exploit compositionality of language, often relying on superficial features. |
| Approach: | They propose to use a knowledge distillation technique to fine tune RoBERTa, BERT and DistilBERT models to improve their performance. |
| Outcome: | The proposed models improve on the CoQA task with linguistic knowledge and are able to represent compositional and lexical information. |